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We evaluate the average number of locally minimal solutions for maximum- a-posteriori 
(MAP) demodulation in code-division multiple-access (CDMA) systems. For this purpose, 
we use a sophisticated method to investigate the ground state properties for the Sherrington- 
Kirkpatrick-type (i.e. fully connected) spin glasses established by Tanaka and Edwards in 
1980. We derive the number of locally minimal solutions as a function of several parameters 
which specify the CDMA multiuser MAP demodulator. We also calculate the distribution 
function of the normalized-energies for the locally minimum states. Wc find that for a small 
number of chip intervals (or equivalently a large number of users) and large noise level at 
the base station, the number of local minimum solutions becomes larger than that of the SK 
model. This provides us with useful information about the computational complexity of the 
MAP demodulator. 
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1. Introduction 

Recently, statistical-mechanical analysis has revealed many important aspects of prob- 
abilistic information processing.^ Among them, many studies addressing the code-division 
multiple-access (CDMA) communication problem succeeded not only in investigating the sta- 
tistical properties of demodulators^'^ but also constructing iterative algorithms based on so- 
called belief-propagation^'^ and examining the dynamics of decoding algorithms.^''' Within 
the framework of Bayesian inference, marginal-posterior-mode (MPM) demodulation provides 
the best possible performance in the sense that its bit-error rate is minimized under a specific 
condition, namely, the so-called Nishimori condition.^' However, it is also possible for us to 
choose another strategy, that is, the maximum- a-posteriori (MAP) demodulator, in order to 
estimate the original information bit for each user from the received signals at the base sta- 
tion. The MAP demodulator attempts to achieve the maximum in the posterior distribution 
of the sent bits. In practice this means that we choose as our estimate of the original infor- 
mation bits the ground state of the Hamiltonian, which is defined by minus the logarithm 
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of the posterior distribution. Therefore, it is quite important for us to be able to evaluate 
how many local minimum (metastable) solutions exist around the ground state, as when we 
attempt to minimize the Hamiltonian to obtain the ground state many local search algorithms 
will get trapped in these metastable states. However, there are few studies to investigate such 
a computational complexity aspect of the CDMA multiuser demodulator. For this kind of 
problem, Tanaka and Edwards^' ^ established a general theory to count the number of locally 
minimum energy states for the model class of the Sherrington-Kirkpatrick spin glasses. -'^'^ They 
showed that the average number of the local minimum states scales (to leading order in A^) 
as ~ e^'^^^^^-^ = 2^^'^^'''^^^ for the SK-type long-range mean-field model. As there exists a 
close relationship between the CDMA multiuser demodulator and the Hopfield model with 
extensive number of patterns, which is itself strongly disordered in a similar way to the SK 
model, their method appeared to be useful for us to investigate the ground state properties of 
the CDMA multiuser MAP demodulator. With the assistance of the Tanaka-Edwards theory, 
in this paper, we evaluate the number of the locally minimum normalized-energy solutions 
for CDMA multiuser MAP demodulation problems. We also calculate the distribution of the 
nornialized-energies of the local minimum states and discuss how often we obtain the deep 
local minimum energy level of the solution for a given parameter set, namely, the number of 
users and the noise level at the base station. 

This paper is organized as follows. In the next section, following the scheme of Tanaka,^' ^ 
wc introduce a model system for the CDMA multiuser demodulator. The MAP demodulator 
is formulated in the context of Baycsian statistics. Then, the energy function to be minimized 
is introdTiccd naturally. In the same section, we define the local minimum solution of the 
MAP demodulator as a fixed point of the zero-temperature dynamics of the CDMA multiuser 
demodulation problem. In section 3, we evaluate the number of local minimum solutions 
for the MAP demodulator by using Tanaka-Edwards theory.^' ^ In the following section, we 
calculate the distribution of the local minimum normalized-energies and make it clear how 
often the deep locally minimum state appears for a given number of users and noise level at 
the base station. It is well-known that the Tanaka-Edwards theory is based on the annealed 
calculation for the average of the macroscopic quantities of the system. Therefore, it cannot 
take into account the effect of the quenched disorder correctly. In order to evaluate the number 
of local minimum states in the proper way in section 5 we attempt to recalculate the number 
of the locally minimum solutions for the MAP demodulator modeling it as a quenched system 
with assistance of the replica method. Then, we compare the result of the annealed calculation 
with that calculated by the replica method. The last section is devoted to a summary of our 
results. 
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2. Bayesian inference for a model CDMA system 

Wc consider the dircct-scqucncc binary phasc-sliift-kcying (DS/BPSK) CDMA code where 
wc have K users, . . . , s^^ which use a spreading code 5^, . . . , 6^, where we define N/K = a. 
The received signal is given by 



where ~ A(0, l//3s) is Gaussian noise and the label ji takes the values ^ = I, - ■ ■ ,N. N 
is the number of components of spreading codes for each user. The CDMA demodulation 
problem is to estimate the original information for each user Si, . . . given that the output 
and the spreading code for each user h\,...,h^ is known. We model the spreading code 
sequences {6^} as sequences of independent identically distributed binary random variables 
with Prob[6f = ±1] = 1/2. 

For this problem, we introduce a model of the system (1): 

y' = ^jlKsk + i^^ (2) 



where si,...,sk are estimates of the corresponding original information bit . . . , s^^^ iov each 
user and is a model of the noise at the base station which follows a Gaussian distribution 
with variance 

Within the context of Bayesian statistics, we consider the posterior distribution which is 
given by 




/3 

exp 



27r 



Ft ^ 
1^=1 



(3) 



where wc choose the uniform distribution P({sfc}) = 2 ^ as a prior. Using these definitions 
we are working with a system which has an cfi^ective Hamiltonian given by 

N , N 



H=l ^ M=l 



which is constructed so that maximizing the posterior distribution corresponds to minimizing 
this Hamiltonian (4). The Hamiltonian gives rise to local fields acting on each spin Sk 

hk{s) = fk-^ JkjSj (6) 
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so that the zero temperature dynamies, which attempts to find the maximum- a-posteriori 
(MAP) demodulator solution, is given via 

Sk = sgn(/ife(s)). (7) 

Additionally, this means that a given state s is a stable fixed point of the dynamics if, and only 
if, hk{s) = AfeSfe, Ajt > VA;. We would like to comment that the above estimate becomes the 
so-called conventional demodulator (CD) if we neglect the second term of the right hand side 
of equation (6) (i.e. we ignore the interactions between different bits in the received message). 

The dynamics (7) actually minimizes the Hamiltonian (4) (i.e. finds its global minimum) 
if there is no local minimum in the energy landscape. However, due to the quenched disorder 
{6^} in (4), which manifests itself in the interactions and fields fk, there exists many 
local minima and the dynamics (7) may well become trapped in one of the locally minimum 
states. Therefore, it is quite important for us to evaluate how many locally minimum states 
exist around the globally minimum state. Obviously, the number of solutions depends on the 
number of users K and the noise level at the base station ^g- Our main goal in this study is 
to make this point clear in a quantitative manner. 

3. The average number of local minimum states : annealed calculation 

In this section, following the method developed by Tanaka and Edwards^' ^(especially, by 
their formulation for the Ising casc^), wc calculate the number of solutions to the dynamical 
equations (7), which arc attempting to construct the MAP demodulator for a given solution 
s of the dynamics (7). We first define the local energy by 

ej = Sifi + Si ^ ^ JijSj. (8) 

Then, according to Tanaka and Edwards,*^ we assume that each bit asynchronously updates 
and the energy difference due to the bit flip — — is given by 

Aei = e- - ej = 2sj /j - ^ JijSj j . (9) 

If we define the parameter Aj in terms of the local field hi{s) via 

hi{s) = /j - ^ JijSj = XiSi, (10) 

then for a given realization of disorder {J,f}, the condition for the solution s to be one of 
the locally minimum states is given as Ae^ > Vz, namely, 

Aei = 2siXiSi = 2Xi > 0. (11) 

Of course, we might modify the condition (11) to investigate the stability against a cluster 
spin flip, however, the analysis for such cases is beyond the scope of our present abilities. 
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Therefore, we can calculate the average number of locally minimum states, {go), through 
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where &{■■■) denotes the step function. The are defined in terms of the output of the 
Gaussian channel y^, the measure of which is given by the probability measure 
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Thus we may write the average number of fixed points of the dynamics (7) as 

X 2- 
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under the assumption that the system is well-approximated as an annealed system. By us- 
ing the saddle point method in the limit of — > oo, the average {go) under the annealed 
approximation is given by 



{go) 



2'k/K 211 jK 2-k/K 2tt/K 

^ = it + uu + ww + qq-^ log {u[l + 2/5^(1 - q)] + (3s{l + t - wf] 
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V 2\f^ 

The details of the derivation is shown in Appendix A. 

We now have to vary this saddle point surface to find its extremum. The definition we 
have used for the error function is Erf(2;) = (2/-y/7r) JJ^dte"*^ so that 
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Varying with respect to the true parameters gives 
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(17c) 

(17d) 
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We see that we can reduce the complexity slightly by introducing s = t — w and s = i = —w 
and then eliminate {t,w,i,w} in favour of {s,s}. This gives us the (slightly reduced) saddle 
point surface as 
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and the saddle point equations as: 
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We solve the equations (19a)-(19f) numerically for given values of the parameters (/3s,a). In 
Fig. 1, we plot the logarithm of the number, namely, the function $ = log(5o)/^ at the saddle 
point (s*, u*, g*, g*, s*, u*). Prom this figure, we find that the number of metastable solutions 
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Fig. 1. The logarithm of the number of solution "1> as a function of a for several values of Ps- The inset is 
/3s-dependence of osk at which $ takes the same value as that of the SK model $sk = 0.19923.* 

for the zero-temperature dynamics (7) is larger than that of the SK model ($SK — 0.19923) 
for large numbers of users and small values of the Gaussian noise. As the number of users 
K = N/a decreases (a increases), the saddle point surface ^ tends to zero so the number of 
local minimum solutions rapidly decreases. However, it remains finite for finite K. 

Prom Fig. 1, we also see that the number of locally minimum solutions decreases as the 
parameter Ps decreases. At a first glance, this seems to be rather counter-intuitive because 
is the inverse of the variance of the Gaussian noise which is defined by (13). However, it 
might be possible for us to show that this fact can be naturally understood. We should notice 
that the Hamiltonian (4) can be rewritten as 

H{s) = ^^SiJijSj -^hiSi (20) 

ij i 

where hi is defined by 

N K r,-l/2 N 

^l=lk=l ^ M=i 

and where t?^ is a Gaussian variable with zero mean and unit variance. The random field hi 
appearing in the above Hamiltonian (20) has zero mean and the variance 
Obviously, if (3s <C 1, the second term of (20) becomes dominant. Therefore, the best way 
to minimize the Hamiltonian H{s) is to minimize the second term of the Hamiltonian (20). 
In other words, making each bit Si in the same direction as the random field hi is the best 
possible strategy to minimize the Hamiltonian. As the result, the frustration, which mainly 
comes from the first term of the Hamiltonian, is weakened. This is a reason why the number 
of locally stable solutions decreases as the parameter (3s decreases. 
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We also should notice that the anomalous discontinuity of the <I>-a curve for Ps = 0.1. 
These demodulation problems as an annealed system have two locally stable solutions for 
$ with large and small overlap at the fixed point of the dynamics (7). This result seems to 
imply that there exists a close relationship between the discontinuity of the ^-a curve and the 
spinodal observed in the bit-error rate.^''^ However, from the pioneering study by Tanaka,^ 
one naturally expects the spinodal more likely to be observed when inter-user interference 
effects are more significant, namely, when the parameter (3s is large. This counter-intuitive 
result might be caused due to our rough evaluation of the ^-a curve by annealed calculation. 
In fact, as we shall see later, the discontinuity disappears when we treat the problem as a 
quenched system. 



4. Distribution of the local minimum energies 

Our next problem is to calculate the distribution of the energies of these local minimum 
states. The local energy — eo is given by 



(22) 



Then, the distribution of local energies is given by 



dA, 



5o({6f,^n) 




X 5 



This is rather challenging to calculate directly, so we assume rather that go{{bf,y^}) is self- 
averaging (following Tanaka-Edwards^'^), or at least a slowly varying function of the disorder 
and make the annealed approximation for this variable. We then look at V{eo) = {go)M{eo). 



En 
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Now we can write the delta function constraining the energy in Fourier representation as 



leoeo 



leo 



(23) 
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Then the calculation proceeds much as the previous one did, leading to a saddle point surface 
given by: 



(^o) = ^Ik^ ' J dtd£ d^du dwdw dqdq dep ^jj^^^^^^^^^^^^^^^j 
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From here we rotate eo — ieo Siud then rcscale eg ^ eo/K. Hence, from now on, we call the 
eo as "normalized-energy" . It is relatively straightforward to read off the final result: 
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From the following equations we see that the saddle point equations will be very similar to 

those we obtained for the calculation of the number of solutions exp[A''$] only now with 

u — ^ + eo- Varying with respect to eo leads to the conclusion that we must have eo = u. We 

can make the same substitutions as before with s and s to find 
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Thus, the saddle point equations are given by 
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In order to solve these saddle point equations, we evaluate the fixed points for a given value of 
eo, then calculate the value of the normalized-energy eg, and finally read off the value of n(eo) 
for the scaling form of the distribution AA(eo) — exp[i('(^ — <!>)] = [n(eo)]^, logn(eo) = ^ — $ 
and then change eg and repeat. This is more straightforward than trying to find the correct eo 
for a given eo- Thus, for the solution of the saddle point equations (24a)-(24g), the distribution 
we seek to obtain is given by 

logn(eo) = eoeo - | log {(n + eo)[l + 2/3.(1 - +/?,(! + sf} 

+ I log {n[l + 2/3,(1 - q)] + + sf} . (25) 
where the variables on the right hand side obviously take their saddle point values. In Fig. 2, 




Fig. 2. The distribution of the minimum normahzed-energy states. In the left panel, the variance of the 
Gaussian noise /3s is fixed to 1.0 and we vary a as 1.2, 2.2 and 3.2. The right panel is obtained by setting 
a = 1.2 and varying /3s as 2, 1 and 0.8. 



we plot the distribution n(eo). From the left panel of this figure, we find that the probability 
for deep normalized-energy state eo ^ 1 is almost zero for all values of the number of users 
a, however, relatively higher normalized-energy states appear much more frequently as the 
number of users increases (a decreases). On the other hand, the right panel tells us that the 
deep energy states frequently appear in the case of large variance of the Gaussian. The 
reason why the deep energy states frequently appear as the variance of the Gaussian noise f3~^ 
increases is the same reason as we explained for the /?s-dependence of the locally minimum 
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solutions. For large value of (3^^, some of the bits 6j take their direction so as to take the same 
sign as that of the loeal field hi whose strength is estimated as a{l + (3^^). As a result, such 
a bit becomes free from frustration effects and hence, the deep energy state appears more 
frequently. However, if (3^^ decreases, the effect of the random field term /ijSj is weakened 
and the frustration has more effect on some of the bits. Therefore, the /3~ ^-dependence of 
the distribution shown in the right panel of Fig. 2 is clearly understood, although we should 
note that of course this docs not necessarily mean that a better decoding result is possible at 
higher noise levels, just that lower energy solutions are more accessible. 

5. Beyond the annealed approach 

In section 3, we considered the quantity go ~ e^*^^'^'-^^) for a given realization of disorder 
{J, /}(= {bf,y'^}) and assumed that the value go is identical to the average {go) in ther- 
modynamic limit. However, for a specific choice of the disorder {J,f}, the go might take an 
extremely large value of exponential order of K and it is difficult for us to confirm that such 
an extreme value coincides with the average (go)- For this reason, we should take the quantity 
log^o instead of and assume that log 50 = K^{{J, /}) for a given {J, /} should be equal to 
the average (log 50) in thermodynamic limit. Then, the log 50 does not take extremely large 
values in comparison with the typical value of log go even if we choose a specific choice of the 
disorder { J, /}. 

However, this will, unfortunately, require more technology and a more involved calculation 
as we will have to introduce replica theory.^ In some ways the previous sections can be viewed 
as an introductory calculation. Now, 



S i 
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using the powerful replica approach. Then, following the usual algebra (similar in many re- 
spects to the earlier sections), we have 
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where we defined m"^, f/;", g"^, u"^^, r"'^ as 
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and their conjugates : m", g"^, u"^, f"'' by introducing the definitions (30a)- (30e) via 
integral representation of delta function as e.g. 

dm"dm° 
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We also introduced the shorthand P(m, r, «) to indicate integral over these saddle point 
variables. 

Then, the replica symmetric ansatz simplifies the saddle point defining (^'q). After a rela- 
tively involved calculation, we obtain 
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The details of the derivation is explained in Appendix B. 



(32) 



12/23 



J. Phys. Soc. Jpn. Full Paper 

We next derive the saddle point equations. By introducing two short-hand measures: 
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ZiS 



9 = 1- 



y/Q -r/ 1 



m = (sso)i 



w = 



-^2(ud - u) 



Z2S 



+ 2- 



+ fd — f — ss'^w + Z2V^^--^s + Z^Vf' 



rs 



Ud 



a + fd — r — ss^w + Z2\/u — fs + zz\f^s \ 

/ 2 

Z2S Z^S 



(33a) 
(33b) 
(33c) 

(33d) 

(33e) 



/ +1 ^ ^ + 

\V^-^ \2^2{ud-u){u-f) 2^2{ud - u)f ^J2{ud - 



u 



1 



rd 



^y2{ud-u) / ^ 
We introduce a further minor shorthand: 

^2 



(33f) 
(33g) 



A={l + rd-ry + {ud -u){l- q) (34a) 
B = 2{w- r)(l + r-d - r) - «(1 - q) - {1 + P'^ + q- 2m){ud - u) (34b) 



By varying the order parameters themselves, we have 

-a{ud - u) 



m 



w = 



Ud 



A 

-a(l + rd-r) 
A 

—au aB{ud — u) 
~A I2 

a{2 + - 2m) aB{l - q) 



A 



+ 



A^ 



(35a) 
(35b) 
(35c) 

(35d) 
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„ ajl + f3-^ + q - 2m) ^ aB{l-q) 

u = + — (35e) 

a{w-l-rd) aB{l+rd-r) 
Td = ^ (35f ) 

a{w-r) aB{\ + rd-r) 
r = ^ ^2 (35g) 

We solve these fourteen equations (33a)-(33g) and (35b)-(35g) numerically to obtain the av- 
erage number of locally minimum states of the CDMA multiuser MAP demodulator treated 
as a quenched system. In Fig.3, we plot that is, the logarithm of the average number 



0.45 



0.3 



= 0.1: quench ■ 
Pi = 0.1: anneal • 




Fig. 3. The average number of locally minimum solutions evaluated by a quenched calculation. The logarithm 
of the number, is plotted as a function of a for 13a ~ 0.1. 



of locally minimum solutions evaluated by the quenched calculation as a function of a for 
= 0.1. From this figure, we find that the number of solutions decreases in comparison with 
the results found in the annealed calculation. This result can be confirmed by the following 
argument. Convexity of the logarithm gives 

(log<7o) < log(f/o) (36) 

and the logarithm of the average number of the MAP solutions evaluated by the annealed ap- 
proximation should be larger than the result of the quenched calculation. Taking into account 
this fact. The result shown in Fig. 3 is quite natural. It should be noted that the discontinuity 
observed in the annealed calculation disappears for the quenched evaluation. From these re- 
sults we conclude that within a much more precise treatments than the annealed calculation 
in the sense that self-averaging quantity here is not go but log go, the average number of locally 
minimum solutions of the CDMA multiuser MAP demodulator continuously decreases as a 
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increases, however, it is still of exponential order. The result we obtained here might pro- 
vide useful information about the computational complexity which could help in constructing 
sophisticated algorithms to obtain the solution for the CDMA multiuser MAP demodulator. 

6. Summary 

In this paper, we investigated the ground state properties of the CDMA multiuser de- 
modulator, in particular, the number of locally minimum solutions of the zero-temperature 
dynamics of the MAP demodulator by both annealed and replica symmetric calculations. 
Moreover, we evaluated the distribution of the local minimum normalized-energy. We found 
that the number of locally stable solutions of the MAP demodulator is larger than that of the 
SK model for a large number of users and small values of the deviation of the Gaussian noise. 
We also found that when the number of the users K decreases, the saddle point surface also 
decreases. However, it never reaches zero for finite K and as a result, the number of solutions 
turns out to be exponential order. Prom these results, we might have useful information when 
we attempt to construct an algorithm to search for the ground state of the CDMA Hamilto- 
nian (4). Prom the evaluation of the distribution of the local minimum normalized-energies, 
we found that the probability for deep normalized-energy state eo S> 1 is almost zero for all 
values of the number of the users a, however, relatively higher energy states appear much 
more frequently as the number of the users increases (a decreases). The analysis also told 
us that the deep energy states frequently appears for the case of large variance of the 
Gaussian. 

We hope that our analysis here provides a useful guide for the engineers to construct the 
MAP demodulator for CDMA systems. 
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Appendix A: Derivation of the average number of solutions by annealed calcu- 
lation 

In this appendix, wc explain the details of the derivation of the average number of locally 
minimum solutions from the definition (14). First of all, we introduce new variables v^^ and 
by inserting the equations: 



i=n/*>-k-;^E«l=/n 

M L ^ fe=l J M 



2n 



exp 



(A-l) 



and 



/n[ 



27r 



exp 



1 > v^\v^ 



1 ^ ' 



(A.2) 



Then, equation (14) is rewritten as 



{go) = 2- 



2tt J 



N 



s,6' i>" ' 







E/n 

n ^ex 
' i-ioo 27ri 



^ 27r 27r 



exp 



/3. 



AT 



o^2 



•,-NK 



=E«"^-^E*r(^. 



1 



X exp 



0" 



ifc=i 



1 ^ 



ifc=i 



where we used (6f )^ = 1. We next focus on the average in the last line in the limit of if — oo: 



2-^^ E ^-p 



E E + ^^^^ + Afe^'' - Xkvn 



JJexp 



log cosh 



exp 



and this reads 



too) = 2 



27ry 



n 



^ 27r 27r 



(A3) 



X exp 



N 



TE(y'^-<)'+iE(«+w) 



En 



°" ^ , /""^ dAi 
dA,- , 

27r 



exp 



i^ Ai(a - \i)si 
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X exp 



By introducing the following order parameters: 

9 = 



w 



k 
k 



Via 



f dqdq ( I 



1 = 



2t:/K 

dtdt 
2'k/K 

dtidn 
2tt/K 

dwdw 
2t:/K 



SkSk 



exp 



exp 



exp 



V k 



k 



we obtain 



1)7 



2TT/K 2'k/K 2-k/K 2'k/K 



X exp 



(A-4) 

(A-5a) 
(A-5b) 
(A-5c) 
(A-5d) 

(A-6a) 
(A-6b) 
(A-6c) 
(A-6d) 



X exp 



27r 27r 



X e 



-tv{v—y)—wv^{v—y) 



-^0 



CO rco J \ , „ . . 

/ 2^giA(a-A)s-i(gssO+«A2+as+?iAsO) 

, 27r 



(A-7) 



Now, we rotate the variables q, u to —iq, —m, and focus on the part: 

J ^ 1 dA ^^giA(a-A)s-((3SS°+uA2+itsA+it&AsO) 

2^70 y-oo27r 
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-u\^+i\[(a-\-t)s-ws'^]) 



By changing the variable A — > X/V^ii, we obtain 



/ = cosh(g) + 



e~«Erf 



a — t — w 



+ e^Erf 



2 



(A-8) 



V 2/^ 

where we used / Dzc"-^ = e"^/^ and Erf(2:) = (2/-y/7r) dte~^^ . We also calculate the other 
integral in equation (A-7), that is, 



dy 



dvdv df "^d-O*^ 



27r 27r 



-e 2 



[y-v°)^ +i{v°v° +vv)- 1 - 1 (€>" )^ -gi)*" - f -tj)(u-2/) — 



/dydv 



e 2[l+/33(l-q^)] 2[l+/3s(l-g^)] 2[l+/33(l-q^)] 



X e 



-|(„_y)2_1^2_1^2(„_y)2_^^(^_^)_ ^g(g*-u')(^-i/)fe ^ Psyvq _^ l3Mlt-^)(v-y) 



[l+/3s(l-q2)] •1-[l+^^(l_g2)]1- [i+^^(i_<,2)] 



where we rotated the variables t,w to — ii, — iw. In this expression, the coefficients of ^v^ 
and yv are given by, respectively, 



B = 



P4q(l + t)-w]^ 
[l + fisil-q')] 



C = ^i±4^^^*±4;i* + ^ + i(i + 1) 



Thus, our integral to be calculated is now written as 



(A- 9a) 
(A-9b) 
(A-9c) 



V2^ [ p 

J 27rA/r 



dydv 



e 2 



42/2-1^2 +C2/^ _ 



^{BA-C^)[l+P,{l-q^)] 
V2^ 



So the average number of locally minimum solutions is given by 



(5o) = 



d^dt d^dn dwdu. dgdg ^Km,u,w,p,iAw,p) 
lixjK 211 /K 2tt/K 2t:/K 



^ = it + uu + ww + qq-^ log [u[l + 2/3,(1 - g)] + /3,(1 + i - wf} 



1 



+ log <j cosh(g) + - 



e '''Erf 

which is just the expression given in (15). 



/ a — t — w 
V 2V« 



e'^Erf 



/ a — i + w 
V 2V^ 



+ 2 log/^^ 
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Appendix B: Evaluation of the replica symmetric saddle point surface 

In this appendix, wc explain the derivation of the replica symmetric saddle point, namely, 
(32) from (29) with (28). By using the replica symmetric ansatz : 



rua = m, rua = m 



Wa = W, Wa=W 



Qal3 = q, Qal3 = Q. 
Ua = U, Ua = U 

we can rewrite the saddle point surface $ as 

^RS = m{rhm + ww + uaUd + r^rd) + i {qq + uu + 2rr) + 77 log 7-^ 

Z Z ZTT 



(B-la) 
(B-lb) 
(B-lc) 
(B-ld) 



+10^ ^ n 



' r dA"dA°" 




J 27r 


exp 



i ^ A"(a - A") - is° ^(ms" + ws'^X" 



exp 



a<f3 a 



+Q;log 



dyU 



a=0 



27r 



exp 



Ik 
2 



a</3 a aj^P 

n n 

(y-.o)^+ij:^"."-k-^E^^-^'?E 



a=0 



2'" 2^'" 2 

a=l a^P 



exp 



- ^^^E*^^" ~ y)*^^/^ -y) - Vom^Va - VOW^{Va - v) 

= n{rhm + iww + UdUd — irard) -I 7i {uu — qq — 2ifr) + — log 

Z Z ZTT 

+ log/i + alog/2. (B-2) 

where we made the rotations: irh m,m ^ u, iq — > —q and if it. We now focus on the 
first integral, Ii, 



i: n /^ 



exp 



i ^ A"(a - A") - is° ^ s"(m + u)A° 



X exp 



— 1- 



E s° I + - 1 I iid - - I > AX - 1 



E - i 9 E 



- i(fd - r) E - E ^"^^^'^ 

Q a/3 



• (B-3) 
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(B-4) 



exp 



— r 



a 



-s" 2_ s"m 

a 



a 



n 



qn 
T 



r dA"dA° 



exp 



Ud 



i ^ A"(a + rd - f - s°s"w; - A" 

y ^ Sq-Aq. j 



u — r 



1+ 



Erf 



a + — f — ss°w; + Z2'\/u — fs + z^^. 



rs 



where we made the transformation: Ud Ud/2 and performed the Hubbard-Stratonovich 
transformations for exp[(g — r){J2a s")^/2], exp[— — r){J2a ■Sa^a)^/2] and exp[f{^Q,(s" + 
is"A")}^/2]. We now turn to the second integral: 



dyll 



a=0 



X exp 



27r 

2 



X exp 



n ^ n 

{y - v'f + i^ - Iv^, - ^ E - E 

a=0 a=l "t^/S 



^{Va - y){vp -y) - Vom'^Va - VQw'^iVa - y) 



-I 



dydv^dv^ 
2^ 



exp 



Ps I 0^2 1-0-0 -'- -2 



n 

.a=l 



dVadVa 

2tt 



X exp 



X exp 



q — r 



\ a / a K oi 



{va - y) 



+ Ud) E(^« - yf + iT- E ^"(^" ~y^~^\ E'^*" + - y) 
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The Hubbard-Stratonovich transformations with respect to the factors: exp[—{q — 
0(Ea*«)V2],exp[-(u - r){J2^{va - u)y/2] and exp[-r{Y,Jva + Va - u)y/2] give 

Z2 = y"DziDz2l?^3^^^^e-^(^-''°)'+'^°*°-5*o| J ^^ivv-v'^mv-v'^wiv-y) 



27r 



6' 



zi 



^/-{q-r)v+^^v'^+Z2^/-{u-r){v-y)+^{u-Ud)(v-y)^+(r-rd)v(v-y)+Z3^^■{v+v-y) 



We should notice that I2 now has the form: 

/2 = ((l + nlogX)/), (B-5) 

with the averages over the disorder variables {zi,Z2, Z3) given by {• • •)z and over the measure 
on y, v^v^ given by (• • • )/. We focus on the inner integral X. By making the change of variable 
V ^ V + y, we have 

e 2(1-9) 

X 



Then, we have 



+ 



2{(l+ird-ir)2 + (urf-u)(l-g)} 



((logX),), = ^/_<| - - log[(l + ir<i - irY + (ud - n)(l - q)] ^(i _ ^) 

1 - I , o l + ir<f-ir) ^ . 

u + 2 [ ; (iw — ir) 

V 1-9 / 

where we used the fact: 

(1)/ = {vl)i = {yvo)i = J-f (2/2)/ = J-f (1 + (B.7) 

V Ps V Ps 

{vovo)i = {yvo)i = H -r {y)i = {vo)i = {vo)i = {vi)i = (B-8) 



s 



with the definition: 



7 27r 

By rotating the variables iw — > u;,ir — ^ r, we obtain 



((logX),), = - i log[(l + r, - rf + (n, - n)(l - g)] 



2{w - r)(l + Trf - r) - tt(l - q) - {1+ +q- 2m){ud - u) 
^ 2{{l +ra-rY + {ud-u){l-q)} 
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Putting Ii and I2 into (B-2), we obtain the replica symmetric saddle point surface: 

-^RS = mm + WW + -qq + -uaua - -uu - r^r^ + rr 



+ Erf 



a + — f — ss^w + Z2\/u — fs + zsVfs 
\/2{ud-u) 



+ - - log[(l + rd- rf + (ua - - g)] 



+ 



2(w - r)(l + rd-r)- u{l - g) - (1 + p'^ + q- 2m)iud - u) 
2{{l+rd-ry + iud-u)il-q)} 
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